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Abstract 

We have analyzed circa 180 navigation paths followed by six learners while they performed three language encoding 
tasks at the computer using an online dictionary prototype. Our hypothesis was that learners who follow an ‘optimal 
path’ while navigating within the dictionary, using its search and look-up functions, would have a high chance of 
successfully completing the tasks. We have found that learners who indeed followed such an optimal path were 
systematically successful in completing the tasks. While alternative paths mostly led to failures, some did, 
nevertheless, lead to success. One didactic implication that emerged from this experimental study suggests that 
‘optimal’ navigation paths can be taught to learners so as to enhance their navigation strategies while they use 
dictionary search and look-up functions for specific language learning tasks, and in turn, increase their chances of 
task success. 

©2012 EUROCALL All rights reserved 

Keywords: online dictionary; CALL task; navigation paths; process-oriented analysis; video-screen capture 


1. Introduction 

In the context of CALL, the analysis of navigation paths (e.g. Renie, 2000), of learner feedback (e.g. 
Heift, 2003; Chun and Payne, 2004) and of learner behaviour (e.g. Gass & Mackey, 2000), has revealed 
key information about the leamer-task-tool interaction: its process as well as its outcome. As computer 
tracking technology becomes more sophisticated as well as more accessible, the technology enables 
researchers and practitioners in CALL to have a more complete (a dynamic and objective) insight into 
this interaction (cf Fisher, 2007) - in collaborative CMC (e.g. Smith, 2008; Madeth et ah, 2011) or 
individual HCI (e.g. Hamel & Caws, 2010) contexts, for instance. Within the latter perspective, we will 
look at the specific learner- task-dictionary interaction context and present a process-oriented analysis 
based on data collected using video-screen capture technology. 
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2. Method 

2.1 Participants, task and tools 

The study (fully described in Hamel, 2012) involved six participants, university students who were 
advanced learners of French (Cl). They had to individually complete three micro-tasks at the computer, 
focusing on their knowledge of French collocations. In total, there were 30 lexical items to find: 10 to 
translate, 10 to complete and 10 to substitute. Here is an example of each task: 

T1 (Translation): a fierce anger: une colere . . . 

T2 (Completion) : Ce chapitre of... des conseils pratiques pour se premunir contre les effets du 
stress. [This chapter of. . . practical advice to avoid stress.] 

T3 (Substitution): commencerune conversation: ... une conversation [start a conversation : ... a 
conversation] 

The participants had access to an online dictionary (cf Appendix 1) if they wished to, during the task 
completion process. This dictionary, called Dire autrement, is a functional prototype (Hamel, 2010) 
developed to answer some of the specific lexical encoding needs of our clientele of advanced learners of 
French (Hamel & Milicevic, 2007). 

The task session at the computer was screen-captured using Camtasia Studio. 

2.2 Data analysis and ‘optimal’ path hypothesis 

The method used to analyse the data collected has been described in Hamel & Caws (2010) and further in 
Hamel (2012). In a nutshell, it involves describing quantitatively and qualitatively the task process and its 
outcome using parameters visible on the computer screen. Such parameters are defined in relation to the 
efficiency and the effectiveness with which participants complete the task with(out) accessing the 
dictionary. Efficiency parameters relate to the efforts deployed during the task process and the duration of 
the task while effectiveness parameters relate to the completeness and the accuracy of the task outcome. 
This being a usability study (Nielsen, 1994), we were concerned with the overall quality of the interaction 
between the learner, the task and the online dictionary prototype Dire autrement, and in particular by the 
use and usefulness of this dictionary in the specific context of this study (Cf Hamel, op. cit.). However, 
for the purpose of this short discussion, we will report on the analysis of the navigation paths followed by 
the participants within the online dictionary during the task process. Our hypothesis was that they would 
start their search keying-in the base-word of the collocation provided for each task items, performing a 
search per Mot (word) and furthering this search within the Liste de collocatifs (list of collocates), 
selecting a collocate from that list and then issuing a look-up for its semantic value under Collocatifs 
(collocates). We referred to this three-step navigation path in the dictionary as the ‘optimal path’ (1. 
search per word^ 2. search within the list of collocates and select a potential collocate 3. look-up the 
semantic value of the selected collocate). The second part of our hypothesis was that by following such an 
optimal path, participants’ chances of successfully finding a correct input for the task item would be high. 

3. Results and discussion 

The results obtained were as follow: 

In total, 178 navigation paths were analysed: 155 of these (87%) were successful paths; that is they led to 
supplying an accurate input for the task item; 23 of these (13%) were unsuccessful paths; that is, they led 
to supplying an incorrect (erroneous) input for the task item. 

Looking at successful paths (cf Appendix 2), we observed that: (a) 37 of these corresponded to our 
anticipated optimal navigation path (24%); (b) 60 were deemed partially optimal, in that they ended with 
a look-up on Collocatifs (39%); (c) 25 were classed as partially optimal, in that they ended with a search 
in the Liste de collocatifs (16%). We observed 33 navigation paths that were deemed alternative (21%), in 
that theywould have started, for instance, with a search by Champ (semantic field) and perhaps ended 
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with a look-up under the Exemples (examples) results. Fully and partially optimal paths aeeounted for 
79% of the task sueeesses. 

Looking at the unsueeessful paths (ef Annex 3), we found that none were optimal navigation paths, as 
antieipated. However, we observed one ease of a partial optimal path ending with a look-up on 
Collocatifs but whieh lead to an erroneous input, and four eases of partial optimal paths ending with a 
seareh in the Liste de collocatifs, whieh lead to erroneous input. There were 18 alternative paths leading 
to erroneous input (75%). These often would start by a searehing for a Mot using a eolloeate-word rather 
than the base -word of a eolloeation. 

To summarize, optimal navigation paths led to no task failure. Fewer than 5% of the partial optimal paths 
led to task failure. Partial optimal paths ending with a look-up on Collocatifs led to sueeess in all but one 
ease observed while those ending with a seareh in the Liste de collocatifs (ef. Appendix 4 for an example) 
led to sueeess in most eases observed (86%). Alternative paths (51 in total) led to more sueeesses (19%) 
than failures (10%). It seems that the seareh proeess rather than the look-up proeess in the dietionary is 
eritieal in terms of leading to sueeess or failure. 

4. Conclusions 

Using video sereen-eapture teehnology, we have been able to observe, in real-time, the interaetions in the 
learner— task— tool triangle, or, more preeisely, a CALL triangle involving six advaneed learners of 
Freneh, three miero-tasks eentred on eolloeations and the Dire autrement online dietionary prototype. We 
have analysed the proeess of this interaetion by looking at the navigation paths learners have followed 
within the online dietionary while attempting to find task items when working at the eomputer. We have 
found that indeed following an optimal navigation path guaranteed sueeess. Partieipants with the highest 
task seores tended to follow either in full or partial optimal paths (where the partial path ended with a 
look-up on Collocatifs) whereas those with poorer seores tended to follow alternative paths or partial 
optimal paths (where the partial path ended with a seareh in the Liste de collocatifs). Analysing failures, 
we now know how eritieal the seareh i.e. the beginning of the dietionary eonsultation proeess is. For those 
less effieient partieipants, more efforts (and time) were indeed deployed at this stage rather than at the 
look-up stage during the entire dietionary eonsultation proeess (Hamel, op. eit.). Analysing sueeesses, 
looking at alternative paths in partieular, we ean aeknowledge that the examples in the dietionary were 
used by partieipants and somewhat useful in providing a eorreet input for task items. 

Some pedagogieal implieations ean be drawn from this study: 

When designing a CALL task (Chapelle, 2001), language teaehers must antieipate not only the 
desired outeome of the task but also the task proeess. 

Language teaehers must provide learners with models of the CALL task proeess. Sueh models 
eould inelude optimal navigation paths assoeiated with speeifie online dietionaries. 

Learners should rehearse the CALL task proeess. 
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7. Appendices 

Appendix 1: The online dietionary prototype: http://web5.uottawa.ea/direautrement/dieo/dieo.php 



~|lchampJlspeaalis^j 


Recherche par mot 


CONVERSATION* 

echange verbal 

CONVERSATION* 

hcaracteristique 


changer 


Icommencer 


couper court 


[i 


[sensj [ActantsJ [synonymesj j^AntonymesJ Logriv^J | Collocatifs ULocutions] IParaphrasesj | Exercices | [AttentionJ 


CONVERSA'i lOr a • nom, fern 
[X et Y] commencer une C. 

Her [~], ^mmenc^, engager, entamer [ART 
se lancer [dans ART 

[X et Y] recommencer une C. 
reprendre [ART 

[X] commencer une C. avec Y 

//er[~ avec N=vy commencer engager, entamer [ART 
ax/ec N=Y], se lancer [dans ART ~ avec N=Y', entrer[en 
~ avec N=Y] 

[X et Y] continuer une C. 

continuer, poursuivre, prolonger [ART 

[X] arreter une C. 


Exemples: 

- Si vous vous etes deja retrouve coince dans une conversation 
interminable avec un importun alors ce service est pour vous. 

- Alors qu'il achetait une bouteille, I'artiste avait remarque deux 
employees engagees dans une conversation animee. 


bL 


Jd 


CONVERSATION* a 
possede 2 exercice(s) : 

♦ Collocatifs adjectivaux 

• Collocatifs verbaux 


Glossaire terminologique 


Appendix 2: Distribution of navigation paths leading to success. 


Path Analysis - Success 



Optimal Paths 


Pathsending 
with Look-up 
"Collocatifs" 
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with Search 
"Liste de 
collocatifs" 


Alternative 

paths 


■ T1 

■ T2 

■ T3 
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Appendix 3: Distribution of navigation paths leading to failure. 



Appendix 4: Example of a failed navigation path ending with a search in the Liste de collocatifs. 


Task Path - Particlpant4 - Thf 

" Z (Examples) 

_ K (Base : Reproche 

_ K (Base : Repro^R^ 
la) 

- I (Mot) 

"€ (End task) 
A Qpput : *injuste 

) 

11:48 

12:06 

12:23 

12:40 

12:58 13:15 

“ S (start task) 
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